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ABSTBACT 



The Personalized Systei of Instruction <PSI) 
represents an^ alternative lethod of instruction to both . conventional 
lecturing and prograiaed ^learning. The j^urpose of this paper Is to 
report on an experiient in which the PSl technique is employed on a 
vicro^coiloiiics course in vhich a 6ne, seaester introductory course vas 
a prerequisite and vas conducted ^n &\siair liberal arts college, A 
total of 92 students were allocated to\three sections of - 
sicroeconoBics, Two of the sect^iops were taught in a\conventioi3al 
lecture foraat and the final section was taught in thdx^si fortat, > ^ 
All three sections set for two one and one half hour perix^s a^ week. 
Each student wast exposed, to the sase body of naterial;? The CQurse was 
based on a conventional text that all sections used» Th« PSI section 
had the text supplemented by written handouts that consisted of the 
kind of elaboration and clarification that would ordinarily occur in 
a lecture. The output of the testing was based upon two instruients, 
the final ^xaaination and the course evaluation. Among the' 
conclusions is that the PSI aethod does provide an alternative 
educational Option that, while not dominating the other methods, does 
seem to offer students ^a choice which they value, Qsed prudently, the 
PSI method can make a valuable addition to the teaching techniques of 
"economicsk Tables related to the text ar^ included, (Author/P6) * , 
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I, Introduction - . * 

An Overview ^ > \^ 

The Personalized System of Instruction (PtS,I.)i Icnown 
also as the Keller Plan in honor of its originatorjDr. Fred Keller 
Professor Emeritus, Columbia University, represents an altema* 
tive method of instruction to both conventional lecturing and < 
programmed learnings Various features of this method have »ad* 
it appealing to a growing number of disciplines and schoolaif^ 
The usefulness of this^ method in terms of where it works best 
and Where it may not work at*all in comparison with alternativ 
methods will be evaluated only aiter a large number of claasrO'^m 
experim§»ts have been run with it. '^ 

In economics few evaluations of this' technique have bee. 
reported in the "literature. Those of which I am aware have be sn 
conducted within the/ environment of a large university and hav ; 
evaluated the application of the technique to on introductory 
economics course. Since the trwsferability of experimental 
results across courses and acjross types of institutions is not 

1, In June, 1972 the Personalised System of Instruoticfri Newa^ 
latter published by the Department of Psychology at" Georget >wn 
University reported that it had been informed of some „190 
courses being offered under the Keller Plan format for auoh 
diverse fiolds as English, sociology and raathematloa. 



2, One experiment was condubted at Vanderbllt by Ben Bolch, 
• Rendlga Pels and Robert Uhler and the other by Eliaaboth ^ 
; Allison at Harvard, The results of the former experiment 
were reported at thd 1972 meetings of the American EconomVc^>- 
Association. - >v » • ( 



at all obvious, the' purpose of this paper ia to report on an 
experiment which la differentiated fro« previous etudiet in twt 
waysi <1) the P.S«li teoinlque was employ e'd on a aiotoeodnonii i 

coui*d6. in which a one semeflter introductory course waa a prere- 
quisite and (2f' the experiment was conducted wlthin^the environ- 
ment >of a small liberal arts college (Williams). ^ 

The Natu re of the Personal tz^dvS.vfltein of Infltruotion 



The P.S.I. -attempts to aid the. student in mas taring , the 
course mslterial ^by allowing hira to proceed .^^t his own pace 
(subject to spme coristraints discussed below) and by providing' / 
*'^P ^i^equent and, rapid feedback as to whether or not he i/ 
in fact mastering the, material'. Structurally, a typical P.S.I. " 
courae is divided up in 16 or bo unitd. Each unit contains i 
(1) an: intrgduction, which relates 'this m\it to previous unita - 
and to 'the .body of the^ course in general, £2) a set of objeoti /es 
in which the student is informed in as^ precise terms as possib'.e 
exactly what the educational objectivf^ of that unit are, (3) i 
set of procedures by which these objectives may be satisfied aid 
(^) a set of sample problems or discussion questions that the ' 
student can use to test his understanding of the material befcj»e 
t«fting a test. 

^Although Pis. I, courses hold normal classroom hours, he 
lectures are delivered during these hours, ^ Instead the time 



1. Special lectures are recommended by the originators of P.S,i. 
to servtf as motivational devices. These lectures, which 
would be open only to students who have passed a particulw 



is used for discussion, explanation and tee^t taking, ICht/ttliDf 
ination of lectures allows the introduction of two degrees of~ 
flexibility not generally shared by lecture courses. In the 
first place> it penaits the ptudent to proceed throui^ the cbu^; e 
material at his own pace instead of forcing 'him to proceed at 
the predetermined pace of the -lectures. This flexibility shoa' d- 
be interpreted Qarefully, however. When the course has a fixe-. 

. . - ^. 

deadline ^r completion, as did the experiment descril^ed here, 
the value of self-pacing lies not in allowing the student more 
time, for it does not do that, but rather in allowing the student 
greater flexibility in allocating the time he or she spends on 
the P.S.i;,. cour.se ove^ the course of the semester. 

The second degree of flexib^ility offered, by the P.S.I, 
is that instead of spending tiiae in the classroom lecturing' 
the professor is available during these hours for individual 
consultation and discussion- with students, /This contact with 
the student is personal in the sense that the discussion with 
the student can be oriented ^tp the specific problems and speci 'ic 
interests of that student. It is this' kind of one-on-one com-v 
ounica'ticn between professor and student which accounts for th » 
■Personaliaed" in P.*S.I. One professor could not possibly gra e 
all the tests, which provide the main^ flow of feedback to the 



unit within a stipulated period of time, would presumably fci 
interesting applications of what was learned in the previou » 
units. The material from these lectures would not be subje .t 
to testing. These special lectures were not used in this 
experiment. 



student, and o»rry on thin kind of tutorUl r«l*t.on«Mp With / 
the stud^n.^ In oour«»» larger tkifin 5-IO otudenta without tho/ 
formation of larga quauas of a tudanta waiting for ao.oaaa to tha 
profaasor. To alleviata thia problav tha faculty maat>«r la 
assisted by undergraduate prootora whose job it ii to grade exaas 
and iprovide answers to the easier questions* Exp)rience has shown 
thcit one proctor for each ten students provides a reasonable 
basia for adequate feeidbaok and discussion. 

The student proceeds through the bourse un .t by unit. 
He passes on to the next unit only when he has de lonsticated 
mastery of the previous unit, Mastery is deaonst 'ated by the 
aehieveaent of a perfect or near perfect score on a unit .test. 
The tests are oonnonly made up of short answer questions xrtiioh 
can be quickly graded by one of the proctors in f .^ont of the 
student. In the case of aissed questions the 8tu<lent is sent 
back to master a specific body of naterial. When he feels he 
has mastered the naterial, he can take a differeh-; test on the 
same naterial* 

' The grading of a P.S.I, course differs fron the conven- 

tional course in a couple of ways. In the first ;»laoe failures 
on unit tests have no direct effect on bourse gra<.e« They merely 
slow the student down. The second aspect of P.S*::. grading is 
that it involves a form of contract between the p.-ofessor and. 
the student. As the Seneater starts both the student and the 
professor know exactly what has to be done for an an A, a 
B and 80 forth. This can be contrasted with the conventional 



practice of curve grading in which aoa^ rtiatrlbutljn oif gm^ta 
la auperimposed over a claaa ranking/ Tha /ornar grading ay^ tea 
tends to be based on more absolute standards or maitery of ' 
natarial while the latter -Vends to be nore relativi. , 

There are other dlfferenofs between P.S.I, and the 
traditional lecture method as well» In P.S.I* knofledge is 
transmitted jprii&arily via the written word as contrasted with 
the mainly verbal tranomission in a lecture/ course Since read- 

as listening and note taking, the two approaches could conce^^tu- 
ally lead to different distributlonB of learning eisong students. 

II, The Nature of the Experiment 

The types of educational objectives which <-ha^cterite 
an economics education range in complexity from tie memorization 
of simple definitions and facts to the acquisition, by the student 
of the ability to reason analytically in an unstn.ctured environ- 
ment. While the P.S.I, seems perfectly appropria* e to satisfy 
the simpler educational objectives it is less cle^.r that the 
method is appropriate for achieving tKe more comp: ex objectives. 
The questions used to^ test the depth of under8tan<.ing on these 
more compjlex and unstructured applications are by their very 
nature essay questions which are not quickly grad d and which 



.^4 



are certainly much lees amenable io proctor gradin.;; thai\ more 

bbjective tests. These characteristios make it di'fioult to ° 

incorporate essay qvidstions into the unit tests. >ince the unit 

tests. are the main means of roinforoing what the student leamSf 

^ ■ . . ■ V ., . . ■ 

this raises the question as to whether tlis use o^f the P.Sil. 

might preoluda this .important for»yOf learning. 

) The -P.S.I, course .designt"^ ror this experiitint attempted 
to ^tl^ulaiV this type of"leaming by taking two 'steips. First - 
Of all the dlscifssion questions in the units which are designed 
to guide the student li> his mastery of the'materiel included 
unstructured essay questions. Seoondly» it was enphasiied that 
although this kind of questidn would not appear or the P.S.I, 
unit tests it would appear on the final. The plar was that the 
discussion questions would focus the ^student's thinking on this 
type of loamin^ and the promise that essay questions would appear 
on the final examination jwoyld drive the student vo the professor' 
to see how one might go about dealing with these Mnds of ques- 
tions. From there the professor oould capitalize on the oppor**. 
timity for a one-to-one relationship provided by -he P.S.I, to 
think through these problems with the student. 

So much for the objectives of the course i ; perceived & 
priori limitations of P.S.I, t'nd modifications to. attempt to 



1. A more serious concern would be that the facul ;y member's 
behavior would be altered as well. When the f iCulty member 
discovered what kinds of learning wero best ac ^.ompiished 
under the P.S.I, he may well be temp*.ed to ell linate all 
other foiTTiS of learning to improve the perfora rnoe of his 
students. 
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ct«al with thdv. The experiment was designed t.o see how this 
method of teaching could aooonplish these goals. Tho rest of 
the paper flumaa. iaes tfte details of the e'xperiittent and thFTe suits 
which were derived from it, . . 

An Oveyview of the Bxi^eriaent 

A tot|4 :o:^ 92 students were Aliooated to three seotions^ ^ 
of aicroeoonoinlcB. Two of the seotions were taught in a .oonveri"* - 
tlonal leotvii-e format and the final section was taught in the ^ 
P,S.I. format* All three sections met fot twQ one and one-half ' 
hour periods a week« Each student was exposed to the same body 

- ' . ' * 

of material i The course was based on avoonventiomtX text whioh^ 
all sedtions used. The P.S.I. section students had' the text 
supplemented by writte^ handouts which consisted' of the kind of 
elaboration and/or clarification that, would ordinarily occur in 
a lecture; 

^ All students were^ administex;ed a common final examination. 
The experim<»nt was designed to compare the It^cture sections with 
the P.S.I, section both on the itiput side (e.^., student time, 
faculty time; material cost) and output side (e.g. final exam 
scores and student perceptions of the' value of the educational 
experience). On the output side the empirical testing was based 
upon two instruments — the final examination and the "course 
evaluation, Theae instruments are so central to this evaluation 
that they are separately ^osoribed below, but first their role 
in the experiment will be discussed. 



V The first ai^ysie was performed on the final exaaiMtioh 
scores. ^The technique of regression analysis was' used to isolat 
insbfar.ae ^possible the unique effects of the teaihin^ method on 
finar^xam score. Specifically the answers for two questions .. ' 
w^re sou^ti ' 

BtSL^5r?«'*5?I^*5^V**^"*f®"^^^ ^'^''••^ the 
f« ?Si f-iJ section and the students " 

til lecture sections in their performance 
. . on^the fl^al ejpimination after controlling for ■ 

other v^i'ious measuitWe influenoiSg factots^^^ 

' JSiSfUJf a^iiitl*'* 'or Is the per- 

i 2^"2J <*l'^««'«»itial higher for students with 
f aJ^J'T* ««<5o?8sful pist perfoJiaAce in 

iS^J^'fiS!! n**^ f^«!i*^ stSdents with a some- 
What lower level of perforaanoe in the past? 

. / The second unit of^alysis i6 the course evaluation for». 

Since these are filled out anonymously, it i» not> possible to / 

link tho responses to a particular student. Therefore, the- 

analysis Of these forms is restricted to oompariscns ofl" mean ^ ' 
scores' across sections. ' 

TWO constraints were imposed 6n the- experie^intal design^ 

Which made the' analysiii somewhat mora difficult U^an would have ' 

been the ca^e if it Were a completely controlled experiment. 

Manpower considerations dictated that no professor ooulV teach 

-ore .thah one section..^ a*de the i«61ation of the technique : 

differences We difficult because they we^e intertwined With 

differences in teaching ability among the faculty members. "Mhe 

method Of controlling for faculty teaching differtmoas isdii. , 
ciiseed below,' ^ 



^The second •constraint resulted fro. the deaire to be f.lr 
to the students, Palmeaa 1« ' 

, , ^aimeae in thie ^aae tranaUted into freedom 

Of .choice. Students were notifi.^ ^ . 

^ V . . ? ^" *^vance whici section was ' 

- ,3^. 3,.«,„ ^.^^^^^ ^^^^ to 

.-. type o, ^^^^ ^^^^^^^^ xne l.p.ot Of th 

ences in attitudes before the course from ; 

. , • . ' " course rrpm attitudes acquired 

during the course o£r instruction. ' , - quired 

inn Final 

. , ' • I > . ■ ■ .. ■ 

* ;The fi«a examination was worth a total of 120 pojints. ' 

»hort answer questions i„ ..ich the otu.on^s ^e.-e given'eight 
statements ana asW to explain .hy the. we.e Lee-S 
secon. , , ^^^^^^^^^^ Which ^^pree.nte. a oo„.i„:/ 

on or a n^erical prohle»s ana, 2 te. „i„ute ai. oussion iues^ ^ 
t Pns ,he final part conaistea of . 'twenty „inu,e ,i.3tils 
- nrst Of Which was a co„pl., .pp^cation of .nell ej u- 

wMch the stuaont was facea with successively .or. aiff icult 
questions concerning the i„pact%f alterative t. ,s\n 

■ • % ■ 

■ '»JeiSse-^-Srs^^ i^e^-^ill?-" 



consumption. .Th« examination ^s, therefor* » composed of a 
variety ojf question types and because of thlvit affords the 
oppor\\inlty to'ti^w Inferences about the robustneijs of student 
ranWn^^ with respect to the structure of the testing Instruaent. 

The examination was put together from a pool of (questions 
submitted by the three faculty members. To avoid possible biases 
in grading, eaoh faculty meinber graded one part of the examliu^tlon 
for all 92 students, without knowing which student's paper was y 
being gyaded. Before the grading commenced scales were drawiv up 
for each of th^ three parts to Insure that an K answer on Part I 
would be 'worth roughjLy the same amount of points 'as an A oh J>art 
II and so'^ forth. 



The. gpHrs^. ?^ 'ftlyRt4o|> 

The course evaluation form used in this report 'is the 
standard Instrument administered to almost all courses at ^ 
Wljlllams College. (A copy of this terra is attached as Appendix , 
A.) On this form students are asked to rate the professor On 
varioud traits usually associated with good teaching and the 
course in terms of Its educational value. These ratings are ' 
based on an ordinal scale from one to seven with a score of 
seven carrying a connotation of outstanding. In assigning these 
ratings the students are asked to compare the professor and course 
being rated with other faculty members and ooUrsed they have ha,d 
at Williams. 



^ There ai^e a nunbeir of dangers in using the results in 
this experiment as a basis for drawing oonolusions about the 
effectiveness of the ?*S.I. for other popult^tions. . The main 
potential bias in using this experiaent to forecast student per- 
form^ce in ropeated application of this'P.S.^. course oirer time 
would be experimenter bias, Past experiments with humahs have 
indicated that the experimenter is not a neutral part. of the 
experiment* His motivation and expectation can influence the 
perfoirmance of the students If, as ir natural, with repeated 
application this mot iyat ion of the faculty member diminishes, so 
may the performance of the students. While there is every reason 
to capitalise on this bias in the short run as a neans of increase. 

' ■ ■ * - * " • . ■ 

ing learning, the perforwanoe differentials which are due sols^ty / 
\f \ ■■' * ' " 

to this experimenter bias may well disappear in tte long run* 

■ ■ ' ' . A. . / " , _ 

A second possible bias, which acts in the, opposite 

- * % ■ 

direction, in using the results of this experiment for forecast- 
* <^ ' " 

ing the results of repeated application stems fron the faci that 

the materials for this course were, used for the*fi.rst time ;ii\ 

this experiments^ Certainly as experience is gained in their 

use significant improvements in them can be 'achieved . !rh'iS 'bias 

would work to increase the performance of^he P.S.I, students 

vis a vis their colleagues in, the lecture seotioni;. 

1, A (good short description of typos of experimen ;er bias can be 
. found in Leonard P, Ullm^ and Leonard Krasner A Psychological 
Approach to Abnormal Behavior (Englewood Cliff ui Prentice- 
Haii;flnc,, !l$^^17pp. 96-^1. 



other 'biases alght ex let if one were to att>npt to extra- \ 

polato the results of this ^^Xperinent to other popilatioAt/ 

The success or failure of a particular F*S.X. cov^se is dependent 

upon the quality 'bf the materials, the quality of the tutors and 

' • ■ i ■ ■ ■ ,■ - 

the type of student, enrolled in t^e course. These will vary 

widely among courlies and schools and difi'erent conbinations of 

these factors will ,y^eld different degrees of success or failure* 

Profile of the Samiple 

_ - ■ . , . - ~, 

Table I presents informatioi^ which is- usefvl for two 

purposes. It portrays" the means of some of the input chaurao- 

teristics of the students which gives a feel for -(he coiaposition 

of the sections. Secondly, it permits the testinf of the 

* -, ■ ^ • ■ ■ . 

hypothesis that allowing students to select their method of 

teaching would lead to quite different student composition in 

the two types of sections. If, for example, the ( tudents who 

had experienced the most success in economics in -he past felt 

that the P.S.I, section offered the best opportuni^^'Cy^or 'them, 

while^the students who had experienced somewhat l()Wer eyticoess 

felt that the lecture method was the best for then, the mean 

economics grade point average should be significajitly higher 

for the P.S.I, section. . , 



i. Out of the 92 students who took the course onl/ /80 had coa- 

glete background repords/whlch were usable for the analysis, 
f these excluded 12 recsor^s 6 were women exchipge students 
and k were foreign studen^. Both groups had either not taken 
the college board tests or had not had their s /ores recorded 
^ on their WllljCams record • The remaining two observations were 
dropp^^bftf^use the final examination which tli'jy took was*not 
directly comparable to the exa© taken by all ^^her students^ 



. * ^ 
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TABLE I 

Wean Values of Selected Student Characteristlca 
for Lecture and P.S.I. Seotlons 



Variable P.S.I* Lectuire Difference of • 

Section Seotlore ><eftog ^-yft^jlp 

Mean Economics Grade^ 8.3^ ?.82 1.290 
point Average 

Mean S.A.T. - Math^ 680.5 682.8 0.165 

Mean S. A. T. - verbal*^ 635.9 0,632 

Mean Age V , 19.2 19.2 0.000 

^This' |rade point average is based on a 12 point scale. 



An 8 13 a B and a 7 le a B-. 

^Theee are the scores received on the Scholastic 
Aptitude Test of the College Entrance Examination 
Board. ' . 



To test for a difference iri student conposltion between 
the two types _ of sections resulting from allowing students to 
select their own method of instruction, a series of difference 
of means tests was run on the four variables given in Table I 
and the resulting; t ratios are given. ^ It Is not possible to . 
reject the hyjJothesis at the 9026^ level of confidence that these 
two samples were drawn randomly from the same parent population. 
In other woi-ds the differenced of means for each of the three 
variables are well within the range which can be attributed to 



1. The description of the t-test used can be found in Alexander 
M. Kood and Franklin A. Gray bill, Introduction to the Theory 
of Statistics . Second edition (New Yorki McGraw Hill Book 
Company, Inc., 19^3) » P. 306. 
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sampling error. Statistically .the hypotheiii that the two typea 
of seotiona are the aane in termV^of these fouis^udent chami?- 
teristics cannot be rejected. Api>arently no ci«|ar advantage' to • 
either method was perceived uniforaly by a single type of student 
is defined by the four variables in Table I."^ '.' 



^ III. An Analysis of -Jrti^ Output Measures 

, T)ve'^jo^n cited advantages of using a P.S.I. method arei . 
r\' (1) Enhanced student performance, (2) better retention of mater-' 
ial for lofiger periodd of time, (3) the students are enthusiastic 
about .t^ing P.S.I, courses and {k) the students are allowed a 
much greater flexibility in allocating their stud;^ time. In * 
t^ie section the first, third and fourth of these potential 
advantages will be examined within the context of the above 
described experiment. Retention will be examined In a'fbllow up 
study .in a couple of yeara. * i 

Student Performance , 

The evaluation of student performance, based on the test* 
ing insstrument described A^ye, is concerned with three ques- 
tions i (1) does the P.S.I, lead to superior performance? (2) 



1, These resul-ts are in no way concli-sive because all students 
did not have completely free access to either section because 
of course, conflicts and the ceiling imposed on the P.S.I, 
section. One can only speculate on how completely free 
access, would have changed t'he values in Table I. 
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what group of students seened to benafit most fron th« P.S*I* 
-M.. students entering the course wt^ high grade point avemgee? 
students entering the course with low grade point averages^ 
neither?(^ both benefit equally? (3) to what extent are these 
results sensitive to the fora of the testing Instrument? 

The objeotive was to establish whether perforiaanoe dif- 
ferentials exist after controlling for differenoes in stud^t 
abilities. The method of analysis was to develop a line^nf model 
to predict the student's performance on the final examination 
based on his characteristics on entry into the course* This 
mod si can be i^epres<»nted symbolicdlly asi < 

•(1) T^ - ' + BjXj + B2X2 + . « . + Bj^ic + , 

where Tj is the final examination scor^b for the ith stu^dent, 

and the B*8 are the parameters to be estimated* and the X*8 
are 'Student characteristics such as sex* past economics, israde 
point average, scores on the math and verbal portions of the 
Scholastic Aptitude test, age, etc. and the teaching •xperienoe 
of the student's professor* The is a random disturbance term 
which captures all of the other influences on student performance* 
For the^ hypotheses teiists which follow this unobserved, disturbance 
term Is assumed to) be normally distributed* 

For this model there are two hypotheses to be tested* 
!^e first hypothesis is that the Introduotlon oflthd P.S.I, 



\ 

\ 

\ 



1. The linear specification was compared to other functional 
forms which could be' transformed Into linear forms* The 
linear specification had the highest explanatory power of 
any fuiictional form in this class* 
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TABLE II 



Estimates of the Parameters of a Linear 
Model to Predict Final 



V N * 79 


ft** m ^mt) ) 




Variable 


M 4> 4 «■ A 4i A ^ 

EBxiooatoa 




Economics grade, point avezttge 


3.136 


•3.478*» 


S.A.T. - Math 


0.064 ,/ 


2.796«» 


S.A.T. - Verbal ' 


^ -0.003 


-0.^56 


Early Final (l»»early final} 
O^regular final) 


-3.692 


-0.693 


Age of student (in years) 


-1.659 


1 ' A If If 

-1.055 


Had i&ath course at Williams 
(l^yesj 0«no) ' , 


-0.161 

/ 




Sex (losfemalet 0«>male) 


-3.602 


■ • 

-1.03^ 


Teaching experience of professor^ 2.672 
(in years) 


2.^73»* 


PiSelt (X«PiS.I,i O-Lecture) 


-ri.?H3 


-0a97 


PtSileX Egononlcs grade point 


0.6B6 


; 0.392 



^Th spinal was given a month early to all P.S.I, 
stuaents who had finished the course and who wished 
to ^ake the early final. 

^This variable, used as a means for controlling for 
^ differences in teaching experience across seotlonsi 
was defined simply as the number of years teaching 
experience prior to the start of the experiment,. 
That teaching experience is important and needs to 
be controlled for was suggested strongly by th£ 
results in Richard Attiyeh and Keith Lumsden, "Some 
Modem Myths in Teaching Economics i The U.K. txper- 
ience." The American Economic Review . LXII (May, 19?2), 
429-433. 
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3Thl8 int«raotlon varlabi* is defined m th« toonoaiot 
grade point average for P.S.I, students and 0 for all 
other students. 

•♦Statie jically significant at the 99% level of 
confidence. 

method made no difference in the final eTcamination soores of 
equally experienced faculty meaibera. lOie veriflootlon of this 
hypothesis translates into a test that the ^coefficients on the 
•last two variables in Table II are simultaneously tero.^ With 
• an P value of 0.^5 for the test statistic it is impossible to 
reject the hypothesis at any conventional level of confidence. 
The introduction of the P.S.I, method made no statistically 
significant difference in final examination scores, 

The second hypothesis is that the P.S.I, method has no 
discemable differential impact among students who have experl- 
enced varying degrees of success in economics in the past. The 
verification of this hypothesis translates into a test that the 
coefficient for the interaction variable (the last variable in / 
Table II) is zero. The results of this conventional t-test are 
presented in Table II. Once again it is not possible to reject 
the hypothesis for any conventional level of confidence. 

^Although the differences were not statistically significant 
they^ were prjRsent. The interesting fact, is that the sign of the 

^^^^^^^^^ ^ ' ' ) 

1. The appr^bpriate test is given in J. Kmenta, Elements of 
Econometrics (New Yorki The Macmlllan Co., wHV P. 371. 
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TABLB III 



Estimated Percentage laprovement in Pinal . ^ 
Examination Score Reaiatlng froal P.S.I, for 

Students of Differing Abilities ' . ' 

* ' ■ ' ■ Percentages^ 
£ft8t ,g9on9qiA99 V^Vt9Pm<^^ Inprovaaent 

. Highest Quartile . i^^i 

High Middle Quart ile s.l^ 
Low Middle Quartile ■'(fr.2j( , 

Lowest Quartile 2,3j( 
• ■ ' ■ , - » ^ 

coefficient on the interaction term was positive. This means , 
that the number of points improvement in expected final exam 
grade from switching to a P.S.I, section will be higher for 
students with high economios grade point averages than for stu- 
dents with lower grade poln^ averages. Using the coefficients 
presented in 7able II it is possible to compute the percentage 
Improvements for students of differing abilities. This is a 
puzzling and discouraging result because one hope for the P.S.I^ 
would have been that it would have been a boon for the less Able 
student.^ Because the course is based on mastery i one would 
expect a compacting of the final grade distribution for the P*S.t. 



1* It should be noted that more encouraging results were 
achieved using TIPS. See Allen C, Kelley, "TIPS and Tech- 
nical Change In Classroom Instruction," American Economic 
Review . LXII (May, 1972), p. ^25. ftyvflviwy 



section. • 

Having . exaalned th« results for the finad •x»9in«tlon in 
its entirety we now turn to the question of how ■ensitive thet* 
results are to the form of the testing instruaent* The underly- 
ing issue which nakes this an important question is the frequently 
voiced suspicion that the P«S«I« method Is severely haapered by 
the fact that the unit tests, in order to provide rapid and 
frequent feedback and be amenable to proctor grading have to 
consist primarily of shori-., objeotiva questions. Th^ arguMni 
fin that If longer, more subjective questions cannot appear on the 
unit tests then the learning processes which are best evaluated 
by these methods will never take place. The student* indeed, is 
systematically steered away from these forms of learning by llidtr 
Ing positive reinforcement to the more objeotively dvaluated , ' 
skills. Therefore, the argument oontlnues, the P.S.X. is limited 
to teaching concepts which are amenable to evaluation by objec- 
tive, short answer questions which represents only a (small?) j 
part of the desired transfer of knowledge between faculty member 
and student. * ' 

In order to refute or substantiate these suspicions 



1. The variance of final examination grades for the jP.S.I« 

section was smaller than the variance 1:^ the final grades in 
the \ two lecture sections combined and smaller than the vari- 
ance^ in each lecture section separately! however these 
differences were not statistically significant. The variance 
test can be found in A.M. Mood and F.A. Orayblll, Introduotlop 
to the Theory of Statistics . 2nd edition (New Yorki McOraw 
Hill Book Company, Inc., 19^3), PP# 307-308. 



empirloally it wks neo«8sary to triuialats th«B Into hypoth«tiB 
test8»v As a first stop the soore on the f inai txAaination ivas 
disaggregated into four sub-soores* The first three soores were 
the BU^uaXly exoXusive soores aohieved on >aoh of the thret parts 
Of the! examination* The oaih element of differenoe amo^ these 
parts was the oonplexity of the (questions and the time allooated 
to doing them* The fourth su^soore was the total number of points 
aooumulated by the student on the three questions whioh were loss 
oriented toward problem solving and more-oriented toward a dis- 
cussion of the issues* These questions were in an essay format 
and clearly more subjective* These three questions required the 
student I ; (1) to discuss the underlying value judgements In the 
economic concept of efficiency, (2) to expl^n and critique the 
position of the New Left ecohomistto on marginal produotivity 
theory and the income distribution and (3) to trace the general 

' equilibrium effects of a partioular technological change on 
various sectors of a three sector economy. 

' ^ For each of these four oompohent parts of the final 
examination the model was reestimated with the dependent variable 
beitig the score on that portion of the test and the independent 
variables remaining as they wera described in Table XX* Then 
the two hypotheses described above were tested on these four new 

v^sets of data* The test that the P*S«X. method did not make any 
difference could ^ot be rejected* for any conventional level of 

confidence*^ Similarly, thi^^test that improvements in final 

/ . ■ . ■ 

I* The P values were respectively — ..4oi, ,4^5, ,05^ and .106» 

■ ■ / ■•- ■ * ■ ■ 

■ ■ ■ ■. ■ / 



-21- 

' ■ . ■ . ■ ' \ " ■ o . . * ■ 

examination 8cor«8 attributable to tK« P«ij«l, ttoKnl^Ut iftM tK« ^ 
eane for students with differing paet perforiumoe reoorda in 
econoBiioe could not be rejected for any QonventionaJL level of 
confidence,^ 

While these findings are consistent with the acre general 
hypothesis that the P.S.I, method is not severely liaapered by the 
necessity for the unit tests to be of the short, objective variety, 
it is important to report the Measured differences so that fuVvre 
experiments can detemlne whether or not they persist under 
repeated experimentation. 

TABLE IV - \ 

Be tlnated Percentage liaprovement Attributable > 
to the P.S.I. Method by Students of Differing 
Abilities on Component Parts of the Pinal Sxak 



Comj^nents of the Bzaalnation 



Past Performance 


Short 


Medium 


Long 




in Economics 










Highest Quartile 




lo.ejt 


1.1^ 




Upper Kiddle Quartile 


5.9^ 






h:>% 


Lower Middle Quartile 


6'A% 








Lowest Quartile 


6»5% 


2,0% 







The Information In Table IV points out that the distribu- 
tion of educational benefits was affected by the type of question 

■ ■ •• • - . % . 

1, The t-values were respectively — .O50, .488, ,2.62 and »k2Q» 



askeid. On the ehoi^ answer (lutBtions* ' which were the onee aott • 
like thtt format of questions found 'on, th« unit tests i the students 
with th«) poorest past perforttanoe record were benefitted aargin- 

ally more than students with superior past ^performance records # 
This effecti hoYfever» was offset^ by the relit of the examination. 
As the examination questions become longer i mo^e/ complex and 
less structured the poorer students did relatively less weAJ.« . 
For the easay questions and the long answer quejstions apparently 
the poorer student would haveTbeen better off in a lecture . 
section. - 
' Although e;c tjC8t rationalizations of these resUlts must , „ 

^~^e regarded as extremely tentative, in retrospect one explanation 
seems quite plausible* Mastering the material too^ a greater 
input of time on the part of the poorer students t' kk a result 
they had to keep up a constant pace in order to finish the oo\(r8e 
on time, '^They were preoccupied with passing the unit tests and. 
virtually ignored the discussion questions oh the units* Thire- 

- fore they were not able to. develop their powers of generaliu tion 

and ahalytical reasoning in an unstructured environment. to tne 
* ' ■ • . ■ ■ ' '' . 

same. extent as their colleagues with similar past perfozvanoe 

records who were taught by the lecture method* > - 

The students with the best past performance records, 'on\ 

the other hand, could master the material in less time so ^they. 

had more time to pursue these more difficult educational objeo-; 

tives. They discussed the essay questiorte with me and with each 

other and in the process shaj^ened their generalization skills* 



In Short they were abU.toVpUalit* on th* for-at of the F.sTj. 
to acooirplieh a broad range of eduoational objeotiyea whei^a . 

. ^he-slower stuCont vras not. if these con Jebturee are valid, they 
• may weaken the case for P.s.I. oourses taught within the regular 
ae^ester and strengthen the case for P.s.I. courses taught with- 
out* deadline^ for oonpletion. ' " ' 



Student 




Performance on final examlnationa is not the only ori- 
-terion by which the edvioational process can be or should be 

Judged. Other significant facets include the degree to Which 
the course taught the student to pursue the subject «tter on 
his own. the degree to which the course taught the student new 
ways to understand and evaluate probleof and the degree to which 
.the^course provides a basis for discussion outside the classrooa. 
The course evaluation instrument used at Willlaffls. which was 
described above, provides one considerably less than perfect, 
but nonetheless useful, vehicle for assessing these other 
dimensions. ^ 

Table V suamariaes the inforaation from the course 
oriented questions in this evaluation form. The table gives the 

«th-?hT:;ii^ 

ia a POtentiallHSJe^da^XfnllJlii^LSf "^•'^••'^^•^ 
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TABLE V 



Student Verceptionti of Their Bduoatlonal^ 
. Experience in the P*S.I« and Lecture 

Seotione . 

P.S.I. Lecture* Difference of 

^ ^ Taught me to pursue 5.59 4«36 • 2.93** ' 

subject on my own 

StiBulated n«» t<|^is- 5.0? 3.81 ' 3.69** 

cuss the aubjeot in 

general conversation . 

Increased ay apprecl- 5»79 ^.'O 4.12** 
at ion of the subject 

Course has taught me 6,00 5*^5 1.70* 
nevf ways to understand 
and evaluate problems i 

Overall rating of the 6.30 4.96 4.35** 
Educational Value ^ 

iThese are based on an ordinal scale from one to seven 
with seven connoting outstanding. 

' • ■ . ■ 

»*Signif leant at the 95?^ level of confidence, , 

*Signlfib«mt at the 90jt level of confidence. 

roean for each method of teaching and the value of the t-ratlo 
which is the statistic used to test whether these itteans are 
different"^' in a statistical sense. The P.S.I, section received 
a higher rating on all dimensions. In four of the five dimen- 
sions the P.'S.I. mean was significantly higher using a 95^ level 
of confidence and in the remaining dimension the P.S.I, mean was 
significantly higher using a 90^ level of confidence. 

As One thinks .'about these (questions keeping in mind the 



ERIC 



method used In P.S.I, fhe statistloal supftriority of thrP^S.I. 
nay be Burprisln^i, For •xanpl«» ont hypothttlt oould Kavt b««n 
that one of the costB of the highly Indlvldualiatlo approach 
embodied in the^'P.S.I, would be a drop in the interact^pn anong 
students since the students oould conceivably be proceeding at , 
quite different paces. As -shown in the seoorid row in Table V 
the students in ^e P.S.X. s&otion perceived themselves as being 
more stinulated to discuss nlcroeoonomlcs out of olass than did 
their colleagues in the lecture sections* 

In the final qnestion the students were asked to subjec- 
tively rate the educational value of the course* The P.S.I, 
sections perceived the course ^o be of greater educational value 
than did their colleagues. The course evaluation fo^ also asks 
the students to describe their degree of motivation for the 
course by categorlKlng it a^r very highi high, moderate or low. 

The responses to this question by method of teaching are given 

■ ■ - ■ ■ - ■ .i ■■ - 
as Table VI. About 92^ of the 'students in the P.S.I, section 

'J^ TABLE VI 

Student Perceptions of Their Degree of 

Motivation in the P.S.I, and Lecture 

sections 0 

BUy motivation in this course 

can best be described asi £j&Ax L&ClUCi 

Very high ^ 37.0 13.5 

High - 55.6 ^f2.3 

Ucderate ^ 7.4 30.8 

Low 0.0 13.4 
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proclalmed themselvos eithtr highly or v«ry highly Kotlv«t*d 
whilo only 56% of the lecture seotlons r«oor<)ed a ulnllAr degree 

of motivation. While it cannot be detarmlned» given the way the 
question was asked » how much of this difference in aotivatlon 
was already present at the beginning of the semester) the dif- 
ferences are striking. The students in the P.S.I, section 
perceive<itheB8elve8 to be on the whole auoh nore motivated than 
dei their colleagues in the lecture seotions. 

The final piece of information contained in the course 
evaluation was a question which asked the students in retrospeot 
to choose the method of teaching. which they would believe to be 
the best for conducting the microeoononic theory course. The 
tabulated responses aire presented below. 

TABLE VII 

Percentage Responses on Desired Teaching 
Technique for P.S.I, and. lecture Sections 

This course would be best conducted 

Ponaal Lecture 0.0 
Informal lecture with discuseion 3.7 32.0 

P.S.I. 



r 



Of course in a question of this sort there is probably alway^i a 
tendency to prefer the method chosen but once again the di^^fer* 
ehces are striking. On^y one person who took the P.S.X* would 
have preferred a variant of the lecture method, but almost one v 
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quarter of those in the leoture seotiona f«lti in ]retroip«ot» 

that the course would be best taught by the F.S.I* method. 

, • ■ ' * . ■ 

Timing' n^ylW^l^y^ 

One of the desirable aspeots of a P.S.I, method is that 
It provides any student who can master the material at a rate 
faster than the pace taken by the traditional lecture method 
with the opportunity to allocate his study time in a manner con- 
sistent with his individual program. The relevant question, 
however* is whether this option is used to ar^y extent by the 
students. If not, the timing flexibility is a more apparent than 
real advantage. 

The records kept on when eaoh student passed each unit 
indicate considerable diversity among students in the l^ime 
phasing of aiastering the course mat e,rial. Nlne.of the thirty^ 
two persons finished at least one month darj.y« Four more finr 
Ished three neeks early. Two did not complete all the units,' 
but one of these was bedridden with mononuoltosio during a good 
share of the semester. 

An analysis of the persona who finished at least a month 
early reveals, not surprisingly, that they were all B+ or above 
. students in economics in tho past. Not all such students, ' 

1. This dimension of the P.S.I, experience can.either .be con- 
sidered an output, desirable in its own right, or as an input, 
desirable only to the ext<>nt that it leads to superior per- 
--formance. Its inclusion in this report as an output reflects 
the author's Judgement on the relative merits of these two ' 
positions. ' 



hoV^ver. ohoee^thie rapid paoo. Tha student who had oo»pleted 
the fewest number of units (i) when the first person to ooaplete 
the course had finished was a straight A student in eoonoiici. 
This once again reinforces the point that the self-paqing feature 

P.S.I, is a feature which .appears to l>enefit aosUy the stu- 
dents who have already demonstrated a superior <»pability in 
econonics, 

Since eight of the early finishers took an early final, 
it is possible to statistically test the prop<;sition that there 
was no difference in perforoance between those who took the early 
exam and those who took the regular final'. Table II reveals that 
on average the early finishers did not do as well as those irtio ■ 
took the .^ater eyamlnation, but the differences were not statistic 
ally significant. ' An examination of the separate results- for * 
each of the component 'parts of the exam r€iVeals ttiat the sign o? 
the early final variable was positive on the short' answer por«> 
tion Qf the examination and negative for the rest of the exam. > 
Since the iarly finishers used less time to complete the course, 
this result is consistent with the above conjecture that students 
who are the most pressed for Ume .sacrifice the more ooipiioated 
educational objSctives in faVor of mastering the more <Jbj€.otive, ;' 
less general concepts. 

Student-Faculty Inteyfl^^^An 

- . . • * ■,■■■■.■■.■:.■■.■■■,>.•.:..: 

Ancthei* of the alleged benefits o-f the p.s.I. method is 
that it fosters a i)eneficial individualized oonUct between the 
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etudent and the professor. It fosters this kind of oontaot by 
<1) releasing faculty time from lecturing and making that time 
available to students and (2) by meeting with the students in * 
the Classroom where any reluctance to visit ^e professor in 
his office can be circumvented. The course evaluation form 
allows us to test whether this benefit is empirically supported 
by this experittent. One of the questions on the evaluation 
instrument asked the student to rate the value .of individual 
discussions with the instructor on a seven point s'o%le as to how , 
much they had learned from these discussions. Those who had not 
had, such discussions were, to oheok "(lo^ftnH apply." This <iues- 
tion allows us to check both the degree of faculty-student inter- 
action and- the perceived value of this interaction to the learning 
experience. The results are presented in the Table below. 

X TABLE VIII 

\ ■ ■ ' : ^ ■ ". 

^ A Comparison of the Degree of Participation 
in and the Mean Ordinal Value of Individual 
Discussions with the Instructor tn Lecture 
^ and P.S.I^ Sections 

" ' ■ - . ', ■ 

Pi? ill hMmJSl 

•Percentage Reporting „2. . ^ ^ _^ 

Individual Discussions | f'**A 

Mean Ordinal Contribution . 
to Learning (on a Seven i>oint 5.75 3.74' 

Scale) L 



Both differences are significant at the ^99^ level of oon^idenoe*' 



Rir 



1. The test to compare the percentages can be found in Taro Yaaane, 
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It would appsfr that at Xtaftt for thU axp^riiMni^th* P,S«I« 
aittthod does foster an lndlvld\^alltad atudar^t-faoulty rtlationthlt) 
and that thl8> r<ilationahip is paroaivad by tha itudanta as baing 
sonewhat Mra adudational than tha relatlonahlp toatarad by tha 
lacture nathod« 



IV • An Analysis of tha Inputs 

Tha ralationship batwoen inputs and outputa In tha P.S.I, 
method is not^ tha^ saas as in a ragular lactura o^ouraa. Moat of 
the input dif faranoas would b^e raf leoted in dif f eranooa in tha 
monetary cost of running the ooursi, but two would not 
faculty time and student time. Faculty tiaa is not fully ra« 
f looted in the cost because the instructor ia paid in terns of 
the nuabor of sections taught and his salary -is f in tha short 
run at least, not systematically related to the amount of tiita 
that he or she puts in preparing for that olass. Thus two ieaoh'; 
ing techniques i4«iy' appear to oost -^e aame when in fact onoi by 
its vary nature,^ takes much mora tima to prapare. For thi^ 
•reason faculty time will be bonsidered separately. ' - 

Similarly student time is not part o^ the monetary oost. 

Since the P.S.I, method requires the student to take a diore 

■■ <, ' ■• . ■ • ' ' ■ ' ^ ■ 

active role i^ his aduoation, ha or she may wall have to wprk . ^ 

harder»' which may affeot his or her othsr ooursas* -Tharafora> « 

1. Sin(ia this result could- ba sensitive to the faculty atSabars 
involved, thii values for aaoh of tha two lecture emotions were 
examined separataly. The diffarVmoes ara also statistically' 
significant between the P.S.I, section and each of the other 
two peotions separately. 



the dei&ands on student time ai^de .by this P«S*1« oovrte «nd ite 
ifflPAot on other oourtes will aleo be exa^^ned seiMir«tely belpw. 

Faculty Tiye . Of interast to faouXty aeabers it the 
questloni "how nuoh time does it take to prepare a' F.S.I, course 
as compared to^ a regular lecture course?** The first difference 
between these two techniques is that for P. S.Z. sections the 
workload tends to be redistributed more toward the beginning of - 
the course. oeAerally it is recommended that at least one-half 
ot tha units ard unit tests be completed before the dass starts. 
, ThU comparison of the total amounts of timf Involved, 
depends on, the circumstances. After running this experiment 
it is dear that the total time devoted to setting up a course 
of this type was on the order of one and on«-half timem as much 
as is devoted to getting up a lecture qotjurse the first time one 
teaches it. For instructors who have been teaching the sluM 
course for some years and «^o intend to teach it again with only 
minor modifications the initial additional time required to 
switch to a P.S.I, method would be much greater. 

The main dimension of the P.S.I, method which leads to 
this differential is the necessity for writing up to four dif- 
ferent tests for each unit (to allow for multiple failures)* 
Writing this number of test questions which are ooiipi^ensivei 

It The time. estimates in this section are based not on a meticu- 
lous ■ time budget » but rather on some e^^ POS , t » impressionistio 
. estimates. They are rough and approximate * 
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fair and which satisfy the educational objaotivea is a difficult 
proposition, , ' . . 

However, once the materials have been developed the time 
devoted to th4> ?«S.I. method would appear to be only minimally 
higher as long as the basic structure of the course renained the 
same, the reason for its being ninioally higher is that modi- 
fications of the course are slightiLy nore difficult in a P«S.l. 
course since they have to be carefully rewritten for the student 
whereas in a lecture course it io possible to ^ot the change 
down on the lecture notes and deliver the enbellishnent extenpo- 
.raneously* In sitort once the initial tiine has been spent in 
setting up the P.S*I. course the first iiine th) faculty time 
requirements appear to be^ only marginally higher for an instruc- 
tor repea'ting a course regardless of whether he is repeating a 
P.S.I, course or a leoture course. ^ 

Student yime . Th6 course^ evaluat^x^n form provides sotte 

■ ^ 

information on student perceptions of the workload in a P.S.I. \ 
course as compared to the perceptibns of students in the lecture 
sections. As reflected in Tabl/e IX it la ole&r that «or« of 
'the P.S.I, students perceived their workload aa being heavier 
thanx averaige tHan did the students in the iLeoture sections • 
Although the students seemed to find this extra work 
educationally well spent, ad dlsouiised above, the '^<i!^t ion re- . 
mains as to whether or not this increased workload would lower 
studont performanoe in other courses • To answer this question 
the grade po\nt average for the other courses taken during the - 
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TABUS U • • 

Student Poroeptlons of Workload (Per- . 

oentage) 

The workload for this course in ■ •> 

relation to other Wiliiajas Courses ' . 

iiflSL! — ; Left.tMr^ 

Muoh lighter 0.0 2^0 

Lighter 10,? 11.5 

About the same 21,4 . 57.7 

Heavier 64.3 25.0 

Much Heavier 3.6 ;^,8 

Total. 100.0 100.0 



same sejoester as the microeconomios olass ws ooaputsd for every 
student in the sample. Then for the total population this other 
course grade point average was x'egressed against (1)' the ounu- 
latiVe. grade point average at the beginning of the seaester rjid 
(2) a binary variable indicating whether or not the student *Afa8 
a iie;nber of a P.S.I, section. The results of this estiiUition 
werer^ 

where 0^^ • the predicted other course grade point average^ 

C. ■ the cumulative grade point average for the 1th 
student at the beginning of the semesteri 



, Ri ■ 1 if the Student was a nenber of a P.S.I, ^ 
section, 0 otherwise. 

The P.S.I, students did better in their other courses 



1. The numbers in parentheses are the standard errors of the 
coefficients. 



than would have b««n wcptcttd pur«J.y on th«lr grmd« point 
but the differenoe is not dtatlstfcally ^ignlfloant. It would 
certainly appear that the P.S.I, method 4oe8 not detract from 
the other ooursee. ^ 

Coete ■ . r 

The maJji jelemente of ooet are the material coet and labor 
costs. The labdr cosis will differ according to who the in- 
■struotor is, hisj rank and so forth. The following rough esti- 
iBktes of per student costs are based on the assumption that the 
lecture section ajijd the P. I, section are bein/?; taught by junior 
assistant professjojra ealming $12,000 a year for teaching five 
aeotions. , 

TABLE X 

* ■ ■ 

A Cottparison of Per Student Costs for 
Lecture Section vs. a P.S.I. Section 



Typing of Materials 
Duplication of materials 
Facility Pay 
Tutor Pay 

These figures suggest that ii P. S.X. course structured like the 
one described in this paper costs about 20^ more' per student 
thim the conventionai lecture' course largely due to the cost of. 



$. 2.17 $ .25 
2.5^^ ,15 
80.00 aO.OO ^ I • ■ 

. -;i2,op • 

' $96.71 -$80,40 • 



thd tutors. This could be modified; of oour0e» by finding 
nonmonetary vraye to conpeneate the tutors (e.g^f by offering -then 
soae sort of course oredit for tutoring rather than aoney). 

Since the typing costs and faculty costs are fixed and 
tne remaining categories are oharaoterised by constant narginal 
costf it follows that the ftverage obst per student of teaching 
this course by the P. S. I. "''aethod declines asyaptotically 'to $14*54 
per student for a class containing an infinite nuaber of students. 
Although teaching a section by p.S.I. is never cheaper than ; 
a lecture section of equivalent siee taught by one faculty member 
because the fixed costs are largeri it does offer a kind of middle 
of the road alternative to the choice between one very l&rge 
lecture section and more than one small section* It can fil^ , ^ 
this role if it can maintain the kinds of performance standards ^ 
of the sniall sections while using only one faculty member in 
conjunction with tutors. It should be noted, however* that this/ 
kind of approach would make the instructor much less accessible 
to the average student, in the classr'oom.^ The monetary savings 
would be balanced by a reduction in the accessibility of the 
instructor* . .. ■ ^ ' » ' 



1. A logical criticism of this point would be "if pei'formance 
is not affected why should you care about adcesslbillty? After 

• all, ian't it only ^ input?" Ifly ccncem with this logio 
arises from ay firm. belief that not all edubatibnal outputs 
are measured. A case in point would be the disoussions with 
students about tangential points which interest 'the ftudents* 
The value of this kind of discussloh.is to draw the student 
into thinkihg about sconomio problems, more deeply than he had 
before by taking advantage of his interest in this subject* 
This kind of interchange is motivating and valuable but mrely 
measured by a final exam. - 



Y. SuButary and/Conolutl9(ii \ 



Suaaary 



1. There was no atatlstl&lly eignifioant diffaranca 



tu^a 



betwaan tha parfonianoa of the P.S.I, atudahts and tha laoi 
atudanta on either the final axaiaihAtion W a whole or on any' of 
Ita oonponent parte after controlling for atudent ohAraotariatloa , 
and tha teaching experience of their profaaBors, ' - 

2. The diatribution of educational benefita aaong atudanta 
with differing pai<^ performance records in ecbnoaioa was noi unl-' 
fom among oonponent parte of tha axanihation, but ^aaa differ- *" 
ences were not statiatioally significant either, Th« 'atudanta ^ 
with the poorest paat parformanca records acorad batter than ». 
their cplleagues in the lecture peotiona with aquivadant rai^orda- 
on the short tanawei^ objaotiva queationa, but laaa wjill on the 

. ■ r . - ' '^.^ - • - 

longer, aore aubjeotiva quea-flona, %* ' /r- , ,. 'V 

3* The st^depts in the P.S.I, caption paroaiy«4 thaMelvaa- 
to be deriving "significantly mora eduok'tional .vaiua^^4 th^ / ' 

. ^ ' _ , , ■ ' - ■ ' ■■ 

coujpae than did their coUaaguea in tfre*la4J3bura aapiiojia, - ,: 

-• . . • ' , ^ . i- » . • ^ ' •* V •• 

4, The greataat use of tJ^a flej^'ibiiity inherent in; the . 
self-pacing feature of the P^S.I^ wka made, by tha atudanta who' 
had demonatrated superior paaffox^aiAnca in aconoaioa in tha paatt 
Tha slower 'Students worked at^ ateady pace, 

5* The P.«S,I, method aeema to enhance the value of 



Individual disousslons b«tw««n Instructor «nd itudint both by * 
making this Itaming «xp«ri«noe ngr« «vailabl« to studonti and 
by BMiking it a nora valuable part of the laamlng prooanf* 

6, the faculty tine, required to develop this FtS*!. course 
fron Boratohi was roughly one and one-half tines greater than the 

tine required to draw up a leoture course fron soratoh* 

, - \ 

?• Onoe established the faculty tine requirenents for . 
repeating a P.S.I, course appear to be only slightly higher than 
the tine requirements for repeating a leoture course # 

^ 8* A nuch higher per^centage of the students in the P.S.I, 
section viewed themselves as^ working harder than average on this 
course than did the students in the lecture sections. 

9* In spite of this increased vrorkload the P.S.I, students 
did better on their other courses after controlling for differ- 
ences in student abilities, but this better perfors«inoe w».s not 
statistically/ significant. ^ 

10. For the way this experiment was conducted the nonetary 
cost of adninistering the course was about 20^ higher ^er student 

lor th^JR.SvI, l^thod than for the lecture Bjethod, ^ 

* 

gono^uaioftg n • 

In conclusion neither the nost danaglng arguments against 
the P.S.I. systen nor the most compelling arguments for it were 
upiheld by this experiment. It does not appear to be inherently 
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biased toward the aeoonpliehment of sinvle eduoatlonal objec- ^ 
tives. Neither the areas on which it achieved better results 
than the lecture method nor the areas on whioh it fell behind 
' the results for the lecture pethod were characterised by differ- 
enoes large enough to be statist ically. significant* It does not 
appear to provide a boon for the below average student as long as 
the course aust be completed within a deadline* 

It does, however, providejan alternative educatricnal 
option whioh, while not dominating ths other methods, do^s seem 

\ 

\ V- 

, to offer students a choice which they value* U^ed prudently the 
P.S.I, method can make a valuable addition to our arsenal of 
teaching techniques In economics* This oontributioi^ can either 
take :^he form of replacing certain lecture courses by P.S.I* or, 
by adopting one oi- more of the P«S.I. features for incorporation 
into a conventional lecture course. 




